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I.  INTRODUCTION 


1.1  OBJECTIVE 


SCOPE  Electronivjs  Inc.  has  produced  one  target  classifier  under 
the  REMBASS  program,  U.  S.  Army  Contract  No.  DAAKC2-73-C-0121, 

SEI  Job  No.  5010.  *.The  purpose  of  the  program  was  to  design  and 
build  advanced  development  models  of  a pattern  recognition  set 
capable  of  detecting  and  classifying  vehicle  targets  based  on 
principles  developed^'^t  SEI  under  previous  Army  contracts 7^ These 
targets  fall  into  two  basic  areas:  aircraft  and  ground  vehicles. 
Further  classification  is  done  within  these  two  classes  into 
tracked  versus  wheeled  ground  vehicles,  and  rotary  versus  fixed 
wing  aircraft. Figure  1 is  the  overall  block  diagram  for  the 
target  classifr^r\^ 
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1 . 2 RESULTS 


The  techniques  of  data  gathering,  decision  making  and  classifier 
design  have  been  demonstrated  successfully  against  a large  tape- 
recorded  data  base  including  multi-site  data.  Two  taped-data 
demonstrations  were  carried  out,  the  first  with  a breadboard  sys- 
tem, the  second  with  the  ADM  system  using  60  Hz,  llOV  power. 

A field  data  gathering  operation  was  carried  out  and  a new  set  of 
reference  patterns  developed  from  it  during  November  1974  using 
the  SEI  system.  The  new  reference  patterns  were  demonstrated  in 
the  field  at  EPG,  Fort  Belvoir,  Virginia  in  December  1974.  Per^ 
form^ince  was  good,  and  is  documented  in  this  report. 


Software  and  signal  study  aspects  of  this  program  were  highly  suc- 
cessful, including  the  selection  of  features  and  the  structure  of 
the  algorithms. 


Hardware  developm.ent  for  battery-operated  field  deployment  was  not 
successfully  co.mpleted. 
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1.3  PROGRAM  DESCRIPTION 


Both  acoustic  and  seismic  sensors  are  employed  in  this  classifier. 
Signals  from  these  sensors  are  processed  and  digitized  in  the  Fea- 
ture Extraction  Unit  (FEU) . The  FEU  separates  the  signal  energy 
into  frequency  bands  which  are  detected  and  smoothed.  These  de- 
tected channels  are  time-division  multiplexed,  digitized,  and 
delivered  to  the  processor  as  7-bit  digital  words. 

The  processor  is  a Computer  Automation  "Naked-Mini"  LSI  minicom- 
puter, selected  for  its  small  size  and  ability  to  be  repackaged  as 
well  as  for  its  computing  speed  and  capacity. 

The  minicomputer  performs  the  pattern  classification  task  by  com- 
puting the  similarity  of  the  detected  signals  to  statistically 
defined  characteristics  of  the  vehicle  classes  of  interest.  The 
known  signal  class  statistics  are  stored  in  the  minicomputer. 
Decisions  are  recorded  by  the  minicomputer  on  a peripheral  tele- 
typewriter, as  follows: 


DECISION 

DESIGNATION 

Unknown  Target  Detected 

0 

Tracked  Vehicle 

1 

Wheeled  Vehicle 

2 

Rotary  Wing  Aircraft 

3 

Fixed  Wing  Aircraft 

4 

Ground  Vehicle 

5 

Aircraft  | 

e 

The  decision  function  algorithm  is  a decision  tree  using  quadratic 
classifiers  at  each  of  three  binary  decision  nodes. 

The  design  of  this  system  was  based  upon  empirically  derived  sta- 
tistics of  signals  from  instrumentation  tape  recordings.  These 
tape  recordi.ngs  were  primarily  made  at  the  following  sites: 


Rome  Air  Development  Center,  New  York 
Fort  Bragg,  North  Carolina 
Aberdeen  Proving  Ground,  Maryland 
Fort  Belvoir,  Virginia 
Yuma,  Arizona 
Warren,  Michigan 

Results  of  a previous  feasibility  effort  showed  that  data  statis- 
tics are  very  site-dependent  and  that  a robust  classifier  design 
must  be  based  on  multi-site  data. 

The  taped  data  presented  certain  difficulties,  in  that  the  instru- 
mentation introduced  dynamic  range  and,  occasionally,  noise  prob- 
lems. However,  test  results  based  upon  playing  tape  recorded  data 
against  classifier  designs  based  on  the  statistics  of  taped  data 
showed  good  classification  accuracy.  When  the  system  was  deployed 
in  the  field,  it  was  found  that  the  taped  data  upon  which  the  clas 
sifier  parameters  were  based  did  not  adequately  represent  the  tar- 
get signatures  as  observed  directly  through  the  sensors,  and  per- 
formance was  unsatisfactory.  Fortunately,  a method  had  been  devel 
oped  earlier  for  punched-paper- tape  recording  data  directly  from 
the  FEU  digitizer.  Using  this  capability,  it  is  now  possible  to 
quickly  acquire  a new  data  base  in  the  field,  to  maintain  and  in- 
crease a digital  library  of  data,  and  to  develop  new  sets  of  clas- 
sifier coefficients  based  upon  improved  data  bases. 

The  goal  of  this  contract  was  to  produce  four  battery-operated, 
field-deployable  classifier  units.  The  nature  of  the  signal  sta- 
tistics and  characteristics  is  such  that  a significant  amount  of 
computation  is  required  to  make  accurate  decisions.  Two  hardware 
approaches  to  field  deployment  were  discussed  prior  to  undertaking 
this  effort.  The  first  approach  recommended  was  to  use  a micro- 
processor, which  had  the  advantages  of  small  size,  weight  and 
power  consumption.  This  approach  also  had  some  disadvantage  in 
terms  of  the  risk  involved  in  using  new  technology.  The  second 
and  chosen  approach  was  to  transfer  the  processing  from  the 


pi*  Raytheon  701  minicomputer  used  in  feasibility  demonstrations  to  a 

conventional  minicomputer  which  could  be  stripped  down  and  repackaged 
in  a field-deployable  configuration.  The  hardware  problems  with 
this  approach  were  primarily  associated  with  power  consumption,  < 

with  packaging  being  a secondary  problem.  Measures  were  taken 
to  reduce  power  consumption  by  extremely  tight  power  specifications 
on  that  portion  of  the  circuitry  which  was  always  on  (detection, 
analog  front  end,  and  interface  with  the  minicomputer) , and  by 
a design  which  turned  the  computer  on  only  for  brief  intervals 
when  it  was  time  to  make  a decision.  The  computing  time  require- 
ment was  a duty  cycle  of  about  400  milliseconds  every  10  seconds, 
or  4%.  While  the  average  power  requirement  under  this  approach  is 
quite  satisfactory,  peak  current  loads  at  low  voltage  from  the 
batteries  will  still  present  a problem. 


The  state  of  the  project  upon  delivery  is  that  the  software  and 
analysis  tasks  have  been  successfully  completed  and  demonstrated, 
and  a single  working  system  has  been  demonstrated  in  the  field. 
Battery  operation  was  not  achieved,  however.  The  delivered  unit 
operates  off  60  Hz  power  mains.  The  Computer  Automation  minicomputer 
is  operating  off  its  internal  power  supplies,  while  the  Feature 
Extraction  Unit  operates  from  +5.2  volts  dc  derived  from  laboratory 
power  supplies. 

The  decision  at  the  proposal  stage  of  this  program  was  made  in 
favor  of  a stripped  minicomputer  as  opposed  to  the  alternative 
microprocessor  approach.  This  decision  was  based  upon  higher 
cost  and  risk  estimates  made  at  that  time  for  microprocessors  as 
compared  to  minicomputers.  If  the  same  program  were  to  be  under- 
taken at  the  present  time,  the  microprocessor  approach  now  appears 
to  be  the  more  attractive  of  the  two,  emd  would  have  a high  proba- 
bility of  success.  Since  the  beginning  of  the  Power  Spectral  Classi- 
fier effort,  SEI  has  employed  microprocessors  in  both  quadratic 
classifier  a.nd  control  applications  with  good  results. 


n*  since  the  power  problems  remaining  in  the  present  design  are  still 

difficult,  and  since  the  first  field  tests  have  already  been  com- 
pleted, it  is  recommended  that  means  be  found  to  prove  the  feasi- 
bility of  the  Power  Spectral  Classifier  System  with  the  available 
ac-powered  unit.  If  the  results  are  successful,  it  is  recommended 
that  the  Army  proceed  to  engineering  development  of  a system  using 
a low-cost  off-the-shelf  microprocessor  system  to  implement  the 
Power  Spectral  Classifier  using  SEI ' s quadratic  classifier  design. 

The  Feature  Extraction  Unit  is  housed  in  a rugged  waterproof  con- 
tainer capable  of  withstanding  immersion  in  one  foot  of  water. 

Its  computer,  a Computer  Automation  Alpha  LSI,  is  packaged  in  a 
standard  commercial  configuration.  Units  will  not  be  damaged  by 
normal  handling  and  transport. 

The  geophone  used  is  a Geospace  GSC-20D  (8  Hz,  400  ohms).  The  geo- 
phone is  connected  to  the  electronics  by  means  of  a waterproof, 
shielded  and  strain- relieved  connector  and  cable  approximately  20 
meters  in  length. 

The  microphone  is  a Sonotone  B13725  having  frequency  response  from 
20  Hz  to  9 kHz,  and  is  compatible  with  the  requirements  for  ex- 
tracting chosen  target  discriminants.  It  is  appropriately  housed 
in  a ruggedized  cavity  to  withstand  specified  field  environments 
in  the  presence  of  rain,  wind,  and  other  adverse  conditions  without 
physical  damage  or  significant  degradation  of  performance.  It  is 
also  fitted  with  a windscreen  to  cut  down  on  response  from  wind 
pressure  variations.  The  microphone  assembly  cable  is  approxi- 
mately 20  meters  in  length. 
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II.  CIRCUIT  DESCRIPTION 


2.1  FEATURE  EXTRACTION  UNIT 

The  Feature  Extraction  Unit  hardware  processes  analog  inputs  from 
the  microphone  and  seismic  sensor  and  generates  digital  output 
words  for  processing  by  the  Computer  Automation  minicomputer.  The 
digital  words  represent  a power  spectrum  analysis  of  the  incoming 
signal.  The  energy  is  divided  into  frequency  cells  and  a sequence 
of  digital  words  is  generated  indicating  the  amount  of  energy  in 
each  frequency  cell. 

Figure  2 is  a block  diagram  of  the  Feature  Extraction  Unit.  Each 
sensor  output,  seismic  or  acoustic,  is  amplified  and  bandwidth 
limited  in  the  input  bandpa.ss  filter.  The  signal  is  amplitude 
stcibilized  in  the  AGC  amplifier  and  then  divided  into  frequency 
cells  in  the  filter  bank.  The  seismic  signal  is  divided  into  2 
cells,  while  the  acoustic  signal  is  divided  into  12  cells  between 
20  and  300  Hz.  Each  filter  output  is  peak  detected  and  integrated 
producing  a dc  level  representing  the  amount  of  energy  in  that 
particular  frequency  band. 

The  signals  are  sequentially  sampled  by  the  multiplexer.  The  mul- 
tiplexer is  a 16  input  commutator  which  monitors  the  14  frequency 
cells,  the  seismic  zero-crossing  rate  a.nd  acoustic  zero-crossing 
rate.  These  zero-crossing  rate  signals  are  an  indication  of  the 
average  frequency  in  the  input  signal. 

Each  of  the  16  channel  outputs  is  sampled  and  held  long  enough  for 
an  analog- to-digital  conversion  to  be  made.  This  digital  number 
is  presented  to  the  data  bus  of  the  Computer  Automation  minicom- 
puter. 

In  addition  to  the  basic  signal  processing  circuitry,  the  hardware 
contains  timing  and  control  circuitry.  A power  level  detector 


\ 
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Figure-  2.  Feature  Extraction  Unit  Block  Diagram 


analyzes  the  age  control  voltage  and  determines  if  a change  in  the 
background  power  level  has  occurred.  Zero-crossing  comparators 
monitor  the  background  frequency.  "Target  detector"  is  an  OR 
function  of  these  two  conditions.  A power  or  frequency  change 
will  trigger  the  target  detector.  Once  the  target  detector  has 
been  triggered,  the  rest  of  the  timing  and  control  for  the  mini- 
computer is  activated.  The  unit  then  cycles  — on  for  one  second, 
off  for  nine  seconds  — until  the  target  is  lost.  During  the  one- 
second  process  time,  the  system  commutates  through  the  16  signals, 
performs  the  classification  algorithm,  announces  its  decision  and 
then  shuts  off  until  the  next  system  initiate  has  been  generated. 


2.2  DECISION  TREE  LOGIC 

2.2.1  Introduction 

Digitized  representations  of  the  seismic  and  acoustic  features 
will  be  input  to  the  digital  subsystem,  implemented  on  a Computer 
Automation  Naked-Mini  LSI  processor.  The  function  of  the  digital 
suDsystem  is  to  utilize  these  inputs  to  detect  and  identify  the 
seven  classes  of  vehicles  cited  earlier: 


• 

target 

• 

fixed  wing  aircraft 

• 

tracked  vehicles 

• 

ground  vehicles 

• 

wheeled  vehicles 

• 

air  vehicles 

• 

helicopters 

Key  aspects  of  the  decision  algorithm  which  effect  these  identifi- 
cations include: 

• Tree  structure  organization  for  flexible,  sequential 
decision  making. 

• Use  of  quadratic  processors  at  each  node. 

• Post-decision  logic  to  increase  classification  accuracy, 
reduce  false  alarm  rate,  and  reduce  processor  duty  cycle. 


Figure  3.  Power  Spectrum  Classifier 


2.2.2  Decision  Tree 

I 

The  implementation  of  the  recognition  system  utilizes  a multi-level 
decision  tree  structure.  See  Figure  3.  Such  a tree-structure  ap- 
proach to  sequential  decision  making  has  numerous  advantages,  such 
as  the  following; 

j 

• The  tree  structure  may  be  matched  to  the  clustering 
properties  of  the  problem  at  hand.  This  will  prevent 
multimodal  classes  from  degrading  system  performance. 

• The  approach  is  cunenable  to  extremely  flexible  and 
modular  design  techniques,  as  will  be  discussed  in 
this  section. 

9 At  each  step  in  the  decision  process,  we  are  parti- 
tioning the  event  space  into  subclasses,  eliminating 
[ some  classes  from  further  consideration.  Further, 

each  decision  is  of  reduced  order,  thus  increasing 
the  classification  accuracy  to  be  expected. 

2.2.3  Decision  Function 

The  quadratic  node  implements  its  decision  by  operating  on  a set 
of  input  features  in  a nonlinear  way  to  produce  an  output  value 
which  describes  the  similarity  between  the  unknown  input  and  each 
possible  class.  The  class  corresponding  to  the  best  match  is  then 
selected,  subject  to  certain  threshold  constraints.  If  the  set  of 
input  features  is  arranged  in  an  n-dimensional  vector  X,  non- 

linear operator  is  given  by 

^i  “ + ®i2i  ^i 

where  i ranges  over  the  number  of  classes  involved.  is  an  N^n 

matrix,  B is  an  N’^l  vector,  and  C is  a scalar.  As  has  been  demon- 
strated, a Bayes  or  minimum-risk  classifier  may,  under  some  common 
assumptions,  be  simplified  to  the  above  form,  where; 


I 

i 


^i  = 

1 

the  inverse  of  the  co- 
variance  for  class  i 

(2) 

B.  = 
—1 

where  is  the  mean 

vector  for  class  i 

(3) 

and 

^i  = 

T -1 

(4) 

Although  the  above  terms  look  rather  complex,  they  are  precomputed 
and  need  only  be  stored  digitally  or  as  resistor  weights  in  the 
final  implementation  of  the  quadratic  node.  In  fact,  using  the 
above  relations.  Equation  1 may  be  simplified  to; 

g^^  = -(X-M^)^K:^(X-Mj^)  (5) 

where  it  is  manifest  that  only  the  mean  vector  M.  and  the  inverse 

-1 

covariance  matrix  need  to  be  stored  for  each  class.  If  X is 

an  N-dimensional  matrix,  this  means  that  N(N+1)  values  must  be 
stored  for  each  class.  The  price  which  must  be  paid  for  the  in- 
creased power  of  the  quadratic  function  over  the  linear  version 
now  becomes  clear.  As  the  number  of  input  features  increases,  the 
complexity  of  the  quadratic  node  increases  quadratically  while 
that  of  the  less  powerful  linear  classifier  increases  linearly. 
This  obviously  puts  a premium  on  the  efficient  use  of  features. 
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III.  SIGNAL  STUDIES  AND  LEARN  DEVELOPMENT 


I 

The  classifier  learn  was  developed  as  follows.  An  analog  evalua- 
tion data  base  was  selected  from  Michigan,  Fort  Bragg  and  r;>.DC 
sites,  and  included  a variety  of  speeds,  ranges,  and  at  least  two 
vehicles  from  each  class.  It  is  known  that  variations  from  site 
to  site  have  adverse  effects  on  classifiers,  so  a large  data  base 
was  considered  essential. 


' Data  bases  were  digitized  for  training  and  evaluation  of  the  final 

*•  algorithm.  These  data  were  developed  through  the  front-end  Fea- 

ture  Extraction  Unit,  and  consist  of  an  even  distribution  of: 

j • ranges  • vehicles 

• sites  • speeds 


I Figures  4a  through  4d  are  lists  of  tapes  and  vehicle  runs  that 

? were  used  in  developing  the  classifier  learn.  The  size  of  the 

; learn  data  base  was  approximately  200  samples,  with  each  vehicle 

: "run"  contributing  from  6 to  20  samples  depending  upon  the  speed 

j of  the  vehicle  and  its  signal  strength. 

A 

? 


I 


Figures  5a  through  5c  provide  a summary  of  the  learn  evaluation, 
which  was  obtained  by  playing  tapes  from  Fort  Bragg,  Michigan 
and  RADC  into  the  classifier.  Each  tape  was  played  from  beginning 
to  end,  so  it  is  estimated  that  the  learn  data  base  comprised 
about  50%  of  the  evaluation  data  base.  One  class  of  vehicle,  the 
five-ton-truck  class,  has  been  deleted  from  this  summary.  These 
vehicles  had  a classification  accuracy  of  only  40%  (60%  of  the 
time  they  were  called  "tracks") . These  data  have  not  been  inves- 
tigated sufficiently  to  determine  the  reason  for  the  poor  perfor- 
mance. It  could  be  a problem  of  insufficient  five- ten- truck  sam- 
ples in  the  learn,  or  simply  that  five-ton  trucks  "sound"  like 
tracks  in  the  measurement  space.  In  compiling  this  learn  evalua- 
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tion,  two  complete  passes  were  made  through  all  tapes,  one  on 
9/13/74  (Figure  5a)  and  one  on  10/2/74  (Figure  5b) . (The  learn 
itself  was  finalized  on  9/11/74,  and  combined  results  are  shown  in 
Figure  5c.)  Appendix  A provides  a run-by-run  summary  of  the  re- 
sults; it  can  be  seen  that,  although  the  decisions  on  a given  run 
on  9/13/74  might  be  different  than  for  the  same  run  on  10/2/74, 
the  overall  cumulative  scores  remained  rather  stable. 

On  a "run  by  run"  basis,  the  classifier  results  are  equally  en- 
couraging, since  in  the  course  of  most  vehicle  runs,  the  classi- 
fier makes  5 to  15  decisions.  Typical  examples  of  such  runs  are 
shown  in  Figures  6a  through  6e.  Note  that  on  a given  run  there 
may  be  classification  errors,  such  as  on  tape  Bragg  3,  Run  4 
(Figure  6a) . The  two  and  one-half  ton  truck  is  incorrectly  clas- 
sified as  a fixed  wing  aircraft  and  a tracked  vehicle  in  two  of 
the  ten  decisions.  On  the  basis  of  all  decisions,  however,  in- 
cluding six  wheeled,  one  ground  vehicle,  and  one  target,  it  is 
highly  improbable  that  the  target  is  anything  but  a wheeled  vehi- 
cle. Similarly,  on  tape  Michigan  34,  Run  1 (Figure  6c),  the  heli- 
copter is  incorrectly  called  a wheeled  vehicle  twice  and  a ground 
vehicle  once.  On  a run  basis,  however,  it  is  clearly  a rotary- 
wing aircraft,  since  it  is  called  rotary  wing  seven  times  and  air- 
craft once. 
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Figure  4c.  Power  Spectrum  Classifier, 
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Figure  4d.  Power  Spectrum  Classifier, 
Learn  Development  Data  Base,  9/11/74 
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Figure  5.  Overall  Results  Based  Upon  Learn  of  9/11/74 


RUN  I DIRECTION  I VEHICLE/CLASS 


SPEED 


CALLED 


LOCATION 


2-1/2T/2 


22  mph 


2-1/2T/2 


22  mph 


2-1/2T/2 


31  mph 


TARGET,  1 = TRACK,  2 « WHEEL,  3 = ROTARY  WING,  4 « FIXED  WING 
GROUND  VEHICLE,  6 » AIR  VEHICLE. 

Figure  6a.  Power  Spectrum  Classifier,  Learn  Evaluation, 

9/13/74,  Tape  Bragg  3 


0 » TARGET,  1 = TRACK,  2 = t-mEEL,  3 = ROTARY  WING,  4 * FIXED  WING, 
5 = GROUND  VEHICLE,  6 = AIR  VEHICLE. 
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Figure  6c.  Power  Spectrum  Classifier,  Learn  Evaluation, 

9/13/74,  Tape  Michigan  34 
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0 = TARGET,  1 = TRACK,  2 = WHEEL,  3 = ROTARY  WING,  4 = FIXED  WING, 
5 = GROUND  VEHICLE,  6 = AIR  VEHICLE. 


Figure  6e.  Power  Spectrum  Classifier,  Learn  Evaluation, 

9/13/74,  Tape  RADC  2 


IV.  FIELD  TESTS 


Field  tests  for  the  Power  Spectrum  Classifier  were  conducted  at 
Fort  Belvoir's  Engineering  Proving  Ground  test  track.  The  first 
test  consisted  of  evaluating  the  system  with  the  same  learn 
(training  data  base)  that  had  been  used  in  the  laboratory  evalua- 
tion at  SEI,  i.e.,  a learn  that  had  been  developed  from  taped  data. 
In  preparing  for  this  test,  the  following  changes  v;ere  made  to  the 
system  in  an  attempt  to  optimize  system  performance: 

• Differential  input  lines  were  incorporated  in  the  input 
buffers  to  reduce  noise  pickup. 

• Gains  were  adjusted  to  account  for  the  predicted  differ- 
ences in  input  signals  from  live  targets  versus  that 
experienced  with  taped  data. 

4.1  TAPE  DATA  LEARN  EVALUATION 


In  the  site  setup,  an  oscilloscope  was  used  to  monitor  input  sig- 
nals throughout  the  tests.  Two  significant  differences  between 
"live"  data  and  taped  data  were  noted.  First,  the  seismic  signals 
at  Engineering  Proving  Ground  demonstrated  considerably  more  high 
frequency  content  than  signals  monitored  from  tapes.  Secondly, 
the  general  level  of  signals  (both  acoustic  and  seismic)  appeared 
to  be  much  higher  in  a live  environment.  Test  vehicles  of  the  fol- 
lowing types  were  used  in  the  evaluation: 

• 1/4  ton  trucks  (jeeps) 

• 2-1/2  ton  trucks 

• helicopters 

• APC 

• M4  8 tank  s 

The  results  of  these  tests  revealed  that  the  learn  developed  from 
taped  data  would  be  insufficient  for  live  targets.  Virtually  no 
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M48 

7 mph 

82 

22  mph 

50 
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43 
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68 
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56 

jeep 

7 mph 

55 

22  mph 

39 

5 ton 
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70 
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37 

helo 

500  ft 

24 

1000  ft 

34 

1500  ft 

15 

* fixed  wing 

taped  data 

250 

* These  data  were  kept  in  the  learn  from  the 
tape  data  base. 


Figure  7.  Data  Base  for  Learn  Developmenti 
Live  Data  Taken  at  EPG,  Fort  Belvoir 


correct  classifications  were  made.  Approximately  90%  of  the  deci- 
sions printed  out  were  those  of  "target, " while  the  class  deci- 
sions themselves  were  mostly  incorrect.  It  was  evident  that  the 
tape  recorded  signatures  that  were  used  to  develop  the  learn  were 
not  sufficiently  representative  of  actual  targets  at  Fort  Belvoir 
to  permit  a successful  demonstration. 

4.2  LIVE  DATA  LEARN  GENERATION 

In  gathering  data  for  the  learn  at  Fort  Belvoir,  attempts  were 
made  to  get  representative  runs  of  vehicles  as  follows: 

• jeeps 

• 2-1/2  ton  trucks 

• 5 ton  trucks 

• APC 

• M48  tanks 

• helicopters 

Ground  vehicle  data  were  taken  at  7 mph  and  22  mph,  while  the 
helicopter  data  were  taken  at  about  60  kts  and  1000  ft.  Fixed 
wing  aircraft  were  not  available,  so  no  new  fixed  wing  data  were 
taken . 


Figure  7 below  provides  a breakdown  of  the  data  samples  that  were 
used  in  creating  the  final  learn. 

4.3  LEARN  EVALUATION  RESULTS,  LIVE  DATA 

The  results  of  the  learn  evaluation  at  Fort  Belvoir 's  Engineering 
Proving  Ground  are  provided  in  Figure  8.  Run-by-run  data  are  pro- 
vided in  Appendix  B.  The  following  points  should  be  noted  about 
these  data: 

• The  accuracy  of  the  tracked  vehicles  is  cdoout  as  high 
as  could  be  expected,  probably  because  of  the  large 
signals  they  generate  compared  to  other  vehicles. 
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Figure  8.  EPG  Test  Results  Learn  11/19/74  Tests  of  12/09  and  12/10/74 


• Wheels,  in  general,  are  lower  in  accuracy,  and  the  errors 
committed  fall  into  two  categories: 

1)  There  are  20  misclassif ications  of  2-1/2  ton  trucks 
(called  fixed  wing  or  air)  in  two  runs.  Both  of 
these  runs  were  at  7 mph,  using  the  same  vehicle 
that  gave  no  air  misclassif ications  in  three  other 
runs.  These  passes  are  suspect,  and  similar  ones 
have  not  been  witnessed,  even  on  taped  data. 

Although  the  cause  has  not  been  isolated,  it  can 

be  explained  and  virtually  eliminated,  since  tae 
classifier  rarely  has  a problem  discriminating  at 
the  ground  versus  air  node. 

2)  There  were  altogether  42  instances  where  wheels  were 
called  tracks  (39  of  these  were  the  larger  vehicles 
like  2-1/2  ton  and  5 ton  trucks,  while  3 were  jeeps). 
This  is  similar  to  results  seen  with  taped  data, 
i.e.,  wheels  tend  to  be  called  tracks  at  CPA. 

• There  were  no  fixed  wing  aircraft  for  evaluation  purposes. 

• Rotary  wing  aircraft  used  in  evaluation  were  significantly 
different  from  the  one  trained  on,  so  results  were  poor. 
The  system  was  trained  on  a small  “executive"  type  heli- 
copter, but  evaluation  flights  were  by  large  UH-1  craft. 
There  was  virtually  no  similarity  between  the  signatures 
of  these  two  vehicles. 
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V.  CONCLUSIONS 


• Data  gathering,  algorithmic  classifier  design,  feature  selec- 
tion, and  decision  accuracy  have  been  demonstrated  successfully 
in  this  program,  both  against  extensive  taped  data  evaluations 
and  against  an  abbreviated  field  test.  An  ac-povered  model  of 
the  classifier  system  was  delivered.  The  hardware  effort  to 
configure  a battery-powered  minicomputer  ADM  system  for  unsup- 
ported field  test  deployment  was  not  successful. 

• Measured  classifier  performance  indicates  classification  accu- 
racies in  the  vicinity  of  90%  to  be  immediately  attainable. 

As  the  data  base  is  improved  in  quality  and  quantity,  it  will 
be  possible  to  improve  performance  using  new  reference  patterns 
without  changes  in  algorithm  structure.  This  is  done  by  using 
more  representative  data  in  the  calculation  of  reference  patterns. 

• In  the  development  of  larger  and  more  representative  data  bases, 
analog  taped  data  should  not  be  used  unless  absolutely  neces- 
sary. Whenever  possible,  data  should  be  collected  in  the  field 
using  the  SEI-deveioped  system  with  its  own  sensors.  The  mea- 
sured features  are  punched  in  digital  form  on  paper  tape  and 
then  stored  permanently  in  a digital  file  at  SEI.  In  this  form, 
the  data  do  not  degrade  and  are  not  subject  to  calibration  prob- 
lems or  variations  in  playback  equipment.  They  are  recorded 
through  the  same  sensors  and  front-end  equipment  for  which  ref- 
erence patterns  are  to  be  developed.  For  these  reasons,  the 
library  is  eible  to  grow  and  improve  consistently. 

• In  particular,  the  present  library  requires  more  data  on  mili- 
tary helicopters  and  heavy  wheeled  vehicles. 

• The  unit  delivered  under  this  contract  should  be  maintained 
and  used  to  develop  a digital  library  of  multi-site  signals 
including  several  runs  per  vehicle  and  many  vehicles.  Demon- 
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strations  and  evaluations  should  be  performed  on  the  system  to 
develop  performance  statistics  on  its  strengths  and  weaknesses. 

• Engineering  development  of  a new  system  should  be  carried  for- 
ward. The  system  should  be  based  on  a microprocessor  using  the 
same  logic,  classifier  structure,  sensors,  and  processor  param- 
eters as  those  in  the  delivered  system.  A microprocessor,  as 
opposed  to  a minicomputer,  will  reduce  size,  power  requirements, 
weight,  complexity,  and  cost.  Several  units  should  be  built 
for  extensive  evaluation.  Hardware  development  on  the  a-16 
minicomputer-based  system  should  not  be  carried  on  beyond  the 
level  of  maintenance  required  for  data  gathering  and  evaluation. 
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Appendix  A 

DETAILED  RESULTS  FROM  TAPE  EVALUATION 

In  the  following  pages,  the  first  column  is  an  identification  code 
for  information  retrieval  purposes.  The  combination  of  TAPE  and 
RUN  specifies  the  exact  location  of  the  recorded  run.  The  vehicle 
type  is  abbreviated  in  the  VEH  column  and  the  evaluation  date  is 
given  in  the  DATE  column.  LEARN  refers  to  the  generation  date  of 
the  reference  patterns  under  test.  The  remaining  columns,  TGT, 
TRK,  WIIL,  RW,  FW,  G,  and  A,  list  the  number  of  responses  of  each 
type  output  during  the  run. 
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I Appendix  B 

1 DETAILED  RESULTS  FROM  "LIVE"  EVALUATION  AT  EPG 

1 

I 

In  the  following  pages,  the  first  column  is  an  identification  code 
for  information  retrieval  purposes.  The  combination  of  TAPE  and 
RUN  specifies  the  exact  location  of  the  recorded  run.  The  vehicle 
type  is  abbreviated  in  the  VEH  column  and  the  evaluation  date  is 
given  in  the  DATE  column.  LEARN  refers  to  the  generation  date  of 
the  reference  patterns  under  test.  The  remaining  columns,  TGT, 
TRK,  WHL,  RW,  FW,  G,  and  A,  list  the  number  of  responses  of  each 
type  output  during  the  run. 
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